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(54) Browser for documents witli annotations 

(57); The present invention provides a browser for 
•Viewinjs docurnents in Postscript or a similar type for- 
mat, wiii added f unctk>nalr^. The system of the pres&it 
inveition creates information for additional material, 
such as bookmarks, annotations, and hyperiinte. based= 
upon user inputs. The information Includes the position, 
and content of the additional materia^ and the refer- 
ences to other additionai material, the infbjrmatbn fe 
stored in the commente section of the document file or 
in a conre^dnding'auxiliary file, which accompanies the^ 
document file. While a document is being view in a 
browser, the information is used for manipulating ar^l 
traversing the document The.additionai niaterial is pre- 
sented on the display of the document and can be 
selected by the user. The user then reviews the added 
material and can use the hyperlinks to move to other 
portions of the document. Users can add additional 
material. Upon closing the document all of the informa- 
tion is stored for later retrieval. 
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Description 

Field of the {nvention 

[0001] The present invention relates to a computer- 
based system for viewing documentSi in particular doc- 
uments in a PostScript format: More specifically, it 
relates to a viewer which ailows the addition of annota- 
tions to documents and hyperlinKing of annotations 
ywthin these ctocumeritS: 

Background of the Invento 

tO(K)2] A variety of different formats can be used for 
representing documents in a computer. Different stand- 
ards have - developed which are used based i4)on the^ 
objectives for lise of the cfocumeni 
[0003] in word-processing systems, documents are 
typically represented in ASCII codes with formatting 
codes. ASCn codes repr^ent each character by a spe- 
cific digital value. The formatting codes allow different 
tyi3e fonts, character fonts* and portions to be.used^ 
The wbrd-pi'ocessing program ttien generates the charn 
acters In the appropriate fonts and positions for display. 
Since each character is separately represented, char- 
acters can be easily changed, removed, or added. An- 
ASCII-based format also allows simple seardies for 
characters or groups of characters, and can easily rep- 
resent pages. However, representing documents in an 
ASCII-based format has many drawbacks. For example, 
drawings cannot be easily represented in an ASCII- 
based format. T>pically; a word processor uses an 
embecfcled object fiat references a drawing that is 
stored elsewhere in a different formal 
[0004] Graphical based formats address some of the 
defiaencies in an ASCII-based formats, but have addi- 
ttonaf problems. In a t^ical graphical-based format, 
each page of a document is r^resented by bits for each 
iight and dark ^ace on ^e page. i=or exanple,, a .fax • 
machine generates a r^esentation of a document 
which is merely the pixels which are the dark spaces on 
the page representing characters' Such a format how- 
ever, does not allow searching or skipping pages. Also, 
most graphical fornnats do not easily grow or shrink 
since the characters can become distorted. 
[0005] Adobe. Inc. developed a graphical type repre- 
sentation called ''PostScript' which has become the pre- 
mier accepted page-description language. In Postscript 
format, a graphical representation of a page is used that 
allov^ for magnification and shrinking. The PostScript 
format includes any material that fits upon a printed 
page, including figures and drawings. Most documents 
are converted to PostScript format for printing. Most 
documents are converted fo PostScript format for print- 
ing. Most on-line documents^ such as documents on 
CD-ROMs, the Internet, or the World Wide Web. are 
represented in Postscript format. However, there are still 
some significant deficiencies with files in PostScript for- 



mat. Typically, a document viewer simply displays the 
document page as it would appear if print©:!: Since - 
pages in the file are stored sequentially, the viewer must 
go through each page to arrive at a desired page. For 

5 long documents, this can be extremely tedious. Gener- 
ally, jumping around in a docurnent is not feasible. Also, 
Information cannot easily be added to the doctHnertl for 
future reference or for review by others. 
[0006] VVhen one views a paper document; he or 

10 vwll often scan through the pages, turn to other sections, 
or make notes on the documents or In the margir^; 
these actions are not possible in a typical PostScript: 
type document! in ord^ to mbye kourtd in a graphical 
type document, a different foririat ■ referred to as hyper- 

15, text, has been used. The Hypertext forriiat allows posi- 
tioning a link to some other element either another 
object or filei or another place in the file, witii a specific 
position on a paga To activate the link« the user selects 
the identified position. For example. U.S. Patent tio. 

20.. 5.367.621 discloses a generalized link from a refeirence 
point in an on-line book, to an ari3ilrary mul^. media 
object. However, as disclcsed in that patent,, the links 
must be areata by the author of the text when ^e book 
is created. Arbitrary links canriot be added to an exlsting 

25 document. To do so would require , entry of hew codes 
representing links. 

Summary of the Invention 

30. [0007] The foregoing deficiencies in existing docu- 
ment systems are overcome by the present invention 
which includes a browser or viewer for documents, such 
as Postscript documents, with added fundionality. The 
system of the present fhveritioh reads and diis^ays 

35- PostSciipt-type documents. It also allows *ie addition of 
bookmarks, annotations, and hyperlinks in order- to 
more easily move aroind and add irnformation to a Post- 
script document. The infomiation for the bookmarl«, 
annotations, and hyperlinks ^e created by the browser 

40 of the present invention. While the document is being 
viewed, the information and Hnks are used for manipu- 
lating and traversing the document. The information is 
also stored in the comments section of the Postscript 
document so that they can be retrieved later witiiout 

4S compromising the existing functionality and portability of 
the document. The present iiwention can also be used 
with any page description format documents which 
include a comments section or auxiliary file, not just 
Postscriptdocuments. 

so 

Brief Description of the Drawings 
[0008] 

£5 rig. 1 is a block diagram illustrating hardware of a 
computer system which could be used in 
implementing the browser of the present 
invention. 
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Fig. 2 represents the data format for a PostScript; 
docurnent 

Fig. 3 Illustrates a display for the present irivention. 

Fig. 4 is a flow diagrani for operation of the browser" 
according to an ennteodlrnent of the present; 
iriventibn: 

D^flgdO^Msffj 
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[0009] The; present invention, relates to a viewer or 
browser that operates on a computer to view dgitalfy 
stored docurnents. particularly documents in PostScript • 
formats. Fig. t illustrates hardware w^ich could be used is 
in implementing the present invention. As illustrateki in 
Fig. 1, computer sj^em 1 irdudes central processing 
unit (CPU) 10. The CPU 10 can be any type of proces- 
sor, such as those used in general-purpose computers 
for executing instructions. 20 
{001 0] A program memory 21 stores instruction steps 
executed by the GPU 10 in brd^ to read, display and 
modify doctfli^ents. The documents are stored in the 
document meriu^y 20. The program memory 2t and 
document memory 20. can be any type of memories 25 
including RAM, ROM,.CD-ROM. or other digital storage 
medium. Afthpugh the program memory 21 and docu- 
ment memory 20 are illustrated as separate elements, 
they may also be different portioifiSs of the san^ memory 
structure. so 
[0011] A display 30 is connected to the CPU 10 in. 
order to display the documents and other informatim to 
the user, A keyboard 40 and mouse 41 are connected to 
the CPU 10 for the user to di^lay the documents and 
operate the browser. Of coui^e, other devices could be 35 
used by the user in order io hr^nipulate and display doc- 
uments. 

[0012] An input device 50 is connected to the CPU 10 
in order to input document data ^to the document men> 
ory 20. The input device 50 could include a modem for 4o 
connection to an external source such as the internet, 
or other device for retrieving documents in the proper 
fornnat 

[001 3] As illustrates in Fig. 2. document data 70 for a 
Postscript document includes two sections, a data sec- 4S 
tion 80 and a comments section 90. The data section 80 
is divkled into pages 81 -84. each section representing a 
single page of the document. Ordinarily, when the doc- 
ument is displayed or printed, the information for each 
page in the data section is retrieved and processed in so 
order to display or print IhB document The comments 
section 90 is of variable size and allows the addition of 
information unrelated to the actual dl^lay of the docu- 
ment. In the present invention, annotation and hyperlink 
information is stored in the comment section. Thus, the 55 
data section 80 is not affected and the document can be 
printed or displayed by any viewer or tirowser in the 
ordinary manner. Although a PostSaipt format is ilite- 



trated, the present invention can operate with diffa-ent 
fbmiats. The documenUprmat must indudeadata se^^^ 
tfon s^arated into pages and a conrtment section or^ 
au)dliary file. The browser ^Derates in the same manner 
in adding annotations and hyperlinks to the document . 
regardless of the document forrnat 
[001 4] Fig. 3 represents a display 1 00 of a document:, 
according to the present irtvehtionj The documenit in 
PostScript format cart include teict 110 and figures or 
drawings 111, The text 1 10 and the drawings 11 1 ai-e 
stored in the.data section 80 of the document data. The 
browser of the presentTOention retrieves and displa^^ 
this infornnation for each page. Any knowi Postscrifst 
interpreter can be used for this fonctioi.^^^ T^^^^^ 
also allows the addition of annotation icons 120 at ahy| 
location on the page. Of course, for other types of docu- 
ment formats, a corr^poriding, apprcpnite interpreiter 
would be used. The ahnptatidn Icon 120 includes a title- 
122, a representatidrl of additional information or text 
121. and a representation of any hyperlinks 123 to other; 
annotations. Annotations are reviewed and changed 
through a dialog box I30l The dialog box 130 indudes 
space for the name 132 of the iarirtofetion/ a hyperlink 
133 tem; the annotaton, and the text 135 of ttie'annota- 
tion. The dialog box 130 also includes txittons for per- 
fomiing certain functions with respect to this annotation. . 
When the user revises a name, hyperlink destination, or 
text of ^e annotation.: the user- then select the^ 
updafe button .I36i or caricei button 13? in order ta 
change or not change the annotation. The user may; 
also select the remove button 1 38 in order to 'efiminate. 
ihs annotation. The browser di^lay also indudes other 
areas, for manipulating and via^^ing annotations in the 
document At ihe bottom of fte. screen, there are butr 
tons for moving to the previous page 140 and next page" 
141. A hypertext button 142 is used for adding annota- . 
tions or hyperlinks. The user may select the page menu ; 
143 in order to move around in the document or select, 
additional pages.. The fie menu 144 is used to open and 
dose documents arKf exit the system. 
(001 5] Rg. 4 illustrates the flow for a jsrbgram Instan- 
tiating the browser and allowing review of documents; 
At step 200, the data for the Postscript document is read 
from the document memory 20. 
[001 6] A step 200. the comments section of the docu; 
ment data Is read from the document memory 20 in 
order to determine annotations. The annotations are 
stored following delimiters on tine comments section of 
the postscript file. Table 1 illustrates storage of the 
annotation information in the comments section. Of 
course, the annotation information could be stored in 
any format which permits the Information for each anno- 
tation to be retrieved. 



TABLE1 

%BrowserAnnotation 0.0120050 0.072519 
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TABLE I {continued) 
%BfpwserAnnotatiQnName marker 
%BrbwserAnno1ationText adsf 
%a'0wser^hota^6ndEnd ^ 
.^BrpwsferAnnbtatibn 4 0.174938 o:i76245 
%BrowserAnnotat{onName iab^ 
%BrowserAnnotationLJnk 0 
%BrowserAnno^tiqnBacWink p 
%Bf owserAnnotatfontext is an annplatrpn: 
With muit^e 

%BfovsiBerAnho!a^6nText lines 
%Birowsei^nndai6©n£rKi 

[GdlTJ The program the creates a link structure ba^ed 
Dpon the annotation information (step 210). The flr^t 20 
page, is then selected (step 215), and displayed ; (step 
220): Tlie pages are displayed in the same manner:as 
any browser displays a Postscrij:^ f iia the., system the: 
waits for an inpirt fitini the user (step^iSj: liseir may 
irpui tnformatioh using the keyboard 40, mdi^e; 4T, br!: 25: 
o^er input device. The steps to cause action are ^mple 
as illustrated in Fig. 4. At step 230, a user selects the 
previous page by . selecting the previous page button 
140 usifig the mouse; Wheri the previois page \^ 
seized, the page number is ac^us^ed (st^ arKi) sq, 
the preyjous page is then displayed at step 2201 Simi- 
larly, when the nact page button 141 is selected (step. 
24b)ihe page mirnber is adjust^ upwards by one (step: 
245) iard the next page is displayed in step 220. A Go To.: 
page feature (step 250) can be selected using the pagei 35 
menu. The', i^er then inputs: the page number (step: 
255), That page number then becomes the current page 
(step257), which is displayed at step 22a The user can ! 
view an annotetlbn (step 260) by selecting an a;nnotar 
tiba icba When, the annotatibn icon is. selected* the 40 
ahhotatibn diak>g box is displayed (step 265). When the . 
user is done viewing the annotation, the user will select 
the cancel button 1 37 (step 267). A user can go to the 
next linked annotation (step 270) by clicking on the 
annotation portion 123 of the annotation icon 120. As 45 
illustrated in Table 1 . the hyperlink infornnation includes 
the number of the linked annotation, which identifies the 
page and location on the page. The current page then 
becomes ^e target page of the hypertirik and is dis- 
played in step 220. so 
[0018] Finally, the user may or add annotations 
(steps 280-286). To modify an annotation the user 
would select the annotation-insertion icon, which will 
cause dialog box 130 to be displayed. The user can 
then edit the name, hyperlink destinatwn, or annotation ss 
tebct. When the user sdects the update button 136 the 
information is stored with the linked data in order to 
maintain the new Information. If the user, selects the 



cancel button, then any changes are not made to the 
annota.tion. The user may also select the remove button;, 
138 which results in the name. hyperW data ^r^l textj 
bdhg deleted fromlhe link data. 
[001 9] When the user exits the ixowser or document ; 
(step 290) the Information in ^e. linked data is then, 
stored in the comments sectipn of the dcicument data:- 
stored in the document memory. By storing Information 
in the comments 'section, the data pdrtioh of the docu- 
■ msnt is not : affected. The docijment can still be read, 
displayed and printed, by other programs without, the 
annotation information. 

[0020] Having now described a f^ etrteqdimente of : 
the invention, it should be apparent to those skiiled b 
the art that the foregoing is merely iflusfratfve and riot; 
fimfting, having been presented by way of example only. 
Nurnerous nKxiiflca^oris and other embodiments are 
within, the: scope of one of ordinary, skijliri th$ art and 
are opntOTplated as felling within the s^ the 
inveni^on^ def ined by the appended dairnsj 

Claims 

1.= A syst^ 1dr\newing a: document; haivir^ a :cc^ 
ment cteta areacomprisifigr 

. a browser for reading document daS and d(s- 
piaying said document data; 

annotation means for reading additional data in 
said comment data area associated with sail 
{foCMmerrtcfetaiand 

annotation display means for displayi.hg^ the 
additional data v\^h corr^pondir^ pages of 
said document data. 

2> : The. system of , claim 1, furtheir comprising, annota- 
tion creation means for creating additjoner data 
associated with said document data. 

3. : The system of claim 1 . wherein said additional data 

includes a name, a location in said document data, 
and text. 

4. The system of claim 1 , wherein said annotation dis- 
play means displays said additional data as an icon 
at a specified location relative to display of said doc- 
ument data; and wherein saki system further com- 
prises annotation enlargement means for 
displaying said additional data as text when said 
icon is selected by a user. 

5. The system of claim i , wherein said additional data 
includes a hyperlink to a secc^ k)cation in said 
document data; said system further comprising 
moving means; for moving to said second kxation 
so as to display said documant data at said second 
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location. 

6^ TTie.system of claim |, furm^ c(>riprbtr^ 

•Snjibtation storage means for storing saki addi- s 
tidnal data in said cornrneni cfeta area associ- 
ated mfi ^fi document data.- 

7, The systeni of cisim % Wherein said ddcunnient Is in. 

a - PostScript fermat and ; vit^erein said commertl- rp. 
data area is a cot men! field of said dpcumentJ 

step^'of:' 

"is 

reading ddcumerrt data of said docurnent; 

dfeplaying p<^ions of sakl d 

creating addffenal data associated with a loca- ■ ii? ■ 
tioh in said dpcyment data based upon a user 
iiiputi^rKi 

;$tpring said additional data in a cornmatt data 
area d said document ■ ss '- 

9.. The msthcxi of claim 8. further cornprising the step 
oi reacfirig'sai^^^ dat^ In^B pomifieiit da^ 

area icisaid (ii^ument 

30 

10. The method of claim 9, further cqnpnsing the step 
of di^aying said additional data. at . said locaticwi^ 
associated with said document data.. 

tiv The rriethod of: clai ssiid kfcJitional. S5 

data is displayed as an icon; 

the method further comprising the step of dis- 
piayihg sakl addltibna! dkta as text^^^ said; 
idiw'ls .self0 1:^ a user 4a 

12, The method of claim 8, wherein said additional data 
includes a second location associated with said 
document data; 

45 

the method further comprising the step display- 
ing a portion of said document data associated 
with said second location when said associated 
data Is selected by said user. 
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